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Abstract. We study properties of a subclass of Markov processes that have 
all moments that are continuous functions of the time parameter and more 
importantly are characterized by the property that say their n— th conditional 
moment given the past is also a polynomials of order not exceeding n. Of course 
all processes with independent increments with all moments belong to this 
class. We give characterization of them within the studied class. We indicate 
other examples of such process. Besides we give conditions for the existence of 
the families of polynomials that have the property of constituting martingales. 
We also study conditions under which processes from this class are harnesses 
or quadratic harnesses. We provide examples illustrating developed theory 
and also provide some interesting open questions. To make paper interesting 
for a wider range of readers we provide short introduction formulated in the 
language of measures on the plane. 



1. Introduction 

The results we are presenting in this paper can be interpreted also from the 
analytical point of view. They concern Markov processes and probability measures. 
But from the analytical point of view Markov process it is nothing else but the 
two sets of measures. One say n{-,t) indexed by some index set I 3 t, usually 
subset of real line and the other r](., t; y\ s) by the points of the product (t, y, s) € 
I x supp(/i(., s)) x I. Both measures are assumed to be probabilistic i.e. they are 
nonnegative and normalized by 1 and satisfy certain regularity conditions of which 
the most important is the so called Chapman-Kolmogorov condition that states 
that 

/ v{-> "J V, t)r){dy, i; z, s) = n(., u; z, s), 

7 B upp(/i(.,t)) 

for all s < t < u. There is also other condition that relates these two sets of 
measures. Namely 

/ »?(•.*; J/) s)n(dy,s) = fi{.,t). 

•/supp(/i(.,t)) 

All conditions assumed as well as all the results of this paper can be expressed in 
terms of these measures. For example conditions imposed on these measures that 
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define a subclass of interesting for us measures can be easily expressed with the 
help of (i and rj in the following way: 

Vrt > : J x 2n /i (dx, t) < oo, J x n rj(dx,t;y, s) — Q n (y, s,t), 

where Q n denotes certain polynomial in y of order not exceeding n. Finally we 
assume that for every n, m £ N function 

M™ \y\ m V(dx,t;y,s)n(dy,s) 

is a continuous function of s and t at least on the diagonal s = t. 

Similarly the for the results. The problems that we are going to solve in this 
paper are the following: 

1. Is it possible to find a linear combination of monomials x l \ i = 0, . . . , n i.e. 
to find a polynomial p n such that J p n (x;t)n(dx,t;y, s) = p„(y;s) for all s < t. 
Existence of polynomial martingales in the probabilistic language. 

2. Under what conditions J(x — y) n rj(dx,t,y,s) does not depend on y for any 
natural n. Independence of increments in the probabilistic language. 

3. When polynomials defined in point 1. are orthogonal i.e. J p n (x;t)p m (x;t)p,(dx,t) 
= for n =/= m. Existence of orthogonal polynomials martingales. 

4. When / // xrj(dx, t; y, s)g(y, z)r)(dz t u; x, t)fi(dy, s) = J J L(y, z, s, u)n(dz, u; y, s)p,(dy, s), 
where L is a linear function of y and z, and g(y, z) is any bounded measurable func- 
tion of y and z. Harness property in the probabilistic terminology. 

5. When /// x 2 ij(dx,t;y,s)g(y,z)r](dz,u;x,t)fi(dy,s) = J J Q 2 (y, z, s,u)rj(dz,u;y, s)n(dy, s), 
where Q2 is a quadratic function of y and z for all s < t < u. Quadratic harness 

property in probabilistic terminology. 

We prefer however traditional probabilistic notation as more intuitive. 

Hence we study a subclass of one dimensional Markov processes X —(X t )t£i 
defined on finite or infinite segment that has the property that all its conditional 
moments of say order n are polynomials of order not exceeding n. Poisson, Wiener, 
Ornstein-Uhlenbeck processes or more generally q— Wiener and (a,q)— OU pro- 
cesses (described for example in more detail in [16] and briefly in Example[3l below) 
are the examples of such processes. 

To be more specific let us assume the following: 

Let X =(JQ) te j be real stochastic process defined on some probability space 
(O, J 7 , P) where I = [I, u] is some finite or infinite segment of a real line. Cases I = 
—00 or u — 00 are allowed. Let us also assume that for Vi € I : supp X t contains 
infinite number of points and that Vn £ N, t £ K : E \X t \ n < 00. 

Let us denote also J-< s = <j{X r : r £ [a, s]) , F> s = a(X r : r £ [s, b]) and J-" s ,„ = 
cr(X r : r <£ (s,u),r £ I). 

Moreover let us assume that BiVVO <n < N: s ^ t £ I matrix [cov(JQ, X|)]ij = i n 
is non-singular. Processes satisfying this assumptions will be called totally linearly 
independent of order N (briefly N— TLI). 

We will also assume that 3N : EX^X^ are a continuous function of t.s £ I at 
least for s — t where m, j < N. Such processes will be called mean-square continuous 
of order N (briefly iV-MSC). 

Let us remark that sequence of independent random variables indexed by some 
discrete linearly ordered set are not TLI. 
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By L<2(t) let us denote space spanned by real functions square integrable with 
respect to one-dimensional distribution of Xt- By our assumptions in L^{t) there 
exists set of orthogonal polynomials that constitute base of this space. 

Thus the class of Markov processes that we will consider is a class of stochastic 
processes that are TV— TLI and TV— MSC and moreover satisfying the following 
condition: 

(1.1) 3NVN >n>l,s<t: E(X?\F<.) = Q n {X s ,s, t), 

where Q n (x,s,t) is a polynomial of order not exceeding n in x. We will call this 
class of processes Markov processes with polynomial regression of order N (briefly 
N— MPR process). If N can be taken oo then we will talk of simply MPR pro- 
cesses. More precisely we should call this class N— rMPR class i.e. right Markov 
processes with polynomial regression. However until we will consider left (with 
obvious meaning class of Markov processes) we will use the name MPR class. 

Since conditional expectation of every polynomial Q n (X t ]t) (with respect to 
J-"< s ) is a polynomial Q n (X s ; s,t) of the same order there is a natural question if 
one can select a polynomial p n (x; t) in such a way that E(p n (X t ; t)\ T< s ) = p n (X s ; s) 
i.e. that (p n (X; t),F<t) is a martingale. One can also pose another natural question 
when E(Xt — X s y \J-< S ) for all j = 1, 2, ... is non random which would lead to the 
property of having independent increments. 

We answer these questions in the next Section [2j 

The main core of the paper are the two Sections [3] and [4] where we study a sub- 
classes of the MPR class for which there exist the sequence of polynomial martin- 
gales that are also orthogonal with respect to one dimensional marginal probability 
measure. More precisely we will assume that there exist a sequence of polynomi- 
als {Pn(x',t)} n>Q orthogonal with respect to the distribution of X t and such that 
(p n (X; t), T<t) is a martingale (for every n). Such processes will be called processes 
with orthogonal polynomial martingales (OPM-class). Under some mild regularity 
conditions we are able to expand Radon-Nikodym derivative of conditional distri- 
bution (i.e. transitional distribution) with respect to a marginal distribution in 
a Fourier series in polynomials {p n (x;t)} . Following this expansion we see that 
processes of the OPM class satisfying those regularity conditions are completely 
characterized by their marginal distributions. Hence these processes form a nice 
regular class that in our opinion is worth to study in detail. As a result we are 
able to characterize harnesses and further quadratic harnesses within OPM-class. 
Our nicest result (Theorem[3]) concerns necessary and sufficient conditions for OPM 
process to be a harness. 

Open problem are collected in Section [5j Uninteresting, long proofs are collected 
in Section [6] 

2. Markov Processes with polynomial regression 

Let us assume that Q n (x, s, t) — J2k=o 7fc n( s > t) xk ■ Further let us define sequence 
of lower-triangular matrices A n (s,t) = [7^ (s, t)] < ^._ n and let us denote: x[ n ^ 

= [l,X tl Xf. . . .,X?] T G R n+ \ m n (t) = Ex[ n) , m n (t) = [l,mi(t), . . ,m„(i)] T = 
EX[ n \ Using this notation notice that (ll.l[) can be written as: 

(2.1) E{x[ n) \^ s )=A n {s,t)X^. 
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Taking expectation of both sides of (|2.1|) results in equality: m„(() = A n (s, i)m„(s). 
Let us also define two akin matrices namely M n (t) = [mj+j (t)] i n and C„(s, t) 

— [EXlXi]i^ =0 ^ ^ n . Notice that these matrices have the following probabilistic 
interpretation: M n (t) = EX^ n) (x\ n) ) T , C n {s,t) = EX\ n) {xi n) ) T . Multiplying 

both sides of (|2.1|) by and taking expectation results in the following 

equation: 

(2.2) C n (t,s)=A n (s,t)M n (s). 

Let us also introduce the following variance covariance matrices: 

£„(M) = E{x\ n) - m n (t))(X^ - m n (s)) T = C n (s,t) - m n (*)m£(s). 
Let subtract from both sides (|2.ip equality m n (t) — A n (s,t)m n (s) and then let 
us multiply from the right both sides of so obtained equality by (xj™^ — m„(s)) T . 
Finally let us take expectation of both sides. We will get then: 

(2.3) £n(M)= A n {s,t)Z n (s,s). 

Let us remark that although relationship (|2.3|) has nicer intuitive meaning it is less 
informative since (1, 1) entries of matrices £„(s,i) are equal to zero. 
We have the following simple proposition. 

Proposition 1. For TLI, MSC and MPR Markov process of order N for s < t i) 
matrix A n {s, t) is non-singular for n = 1, . . . , N . 

ii) A n (s, u) — A n (s, t)A n (t, u) and A n (s, s) = I— identity matrix. 

Hi) There exists a family of non-singular, lower-triangular, (ri + 1) x (n + 1) 
matrices V n (t), such that for all s < u 

(2.4) A n { S ,u) = V-\s)V n {u). 
iv) Diagonal entries of matrices V n (s) are positive. 

Proof. Proof is shifted to Section [6l □ 
Definition 1. Matrices V^lt) is called structural matrix of of the N—MPR process. 

Corollary 1. For n — 1, . . . , N matrix V n {s)Ti n (t, s)V^(t) is symmetric and ma- 
trix C n (t, s)M^ 1 (s) is lower-triangular. 

Proof. Combining ([JJ, (|2.4j) and the fact that matrix S n (s) is symmetric we have: 
£„(*) = V- l {t)V n (s)^ n (t,s) 

= ^( S ) = i:l(t,s)v^(s){v- 1 (t)f 

from which follows our assertion. Similarly multiplying both sides of (|4|) by M^ 1 (s) 
we see that C n (t, s)M~ 1 (s) is equal to A n (s,u) which is lower-triangular. □ 

We have the following observation: 

Theorem 1. Let X be N- TLI, N-MSC and N—MPR process with structural ma- 
trixVj^{t). There exist N (polynomial) martingales (Mi(s), J 7 < s ) s6 / , i = 1, ...,N, 
such that each Mi(t) is a polynomial in X t of order at most i if and only if there 
exit family of lower-triangular, non-singular matrices D^(t), t £ I such that 

(2.5) V N {s)D N {t) = V N (t)D N {s). 

for all s, t £ I. If additionally all diagonal entries of matrix V/v(i) are different 
then D N (t) = V N {t) for all t e /. 
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Proof. Is shifted to Section El □ 

Corollary 2. If (Aii(s), J r < s ) s6 / , i — 1, . . . , n are polynomial martingales of some 
process N—TLI, N—MSC and N—MPR X then for every lower-triangular n x n 
matrix F n = [fi,j]i,j=i,..., n , (J2k= ■ fj,kM n -k(s), ^< s ) s eJ , 3 = l,...,n are a/so 
mar£mga/es. 

Corollary 3. For a N-TLI, N-MSC and N-MPR Markov process for which 
condition \2. 5\) is satisfied and additionally if all diagonal entries of matrix Vn 
are different then there exist a N x N lower-triangular matrix Fn = [fi,j] i j—i n 

with independent on t entries such that (vj,j(t) Yjk=i fj,kXf°, ^F<t), j = 1, ...,-ZV 
are martingales, where Vjj (t) are diagonal elements of matrix Vn (t) . 

Proof. The assertion follows the fact that commuting matrices have common eigen- 
vectors. Secondly notice that eigenvalues of matrix Vn are equal to its diagonal 
elements, consequently since these values are all different matrix Vn are diago- 
nalizable that is can be decomposed as V/v(i) = Fn ■diag[vi : i(t) , . . . , VN^ity-F^ 1 , 
where Fn consist of eigenvectors of Vn (t) . Since condition (|2.5I) implies that Vn (t) 
and Vn(s) commute hence have the same eigenvectors. Consequently entries of the 
matrix Fn do not depend on t. □ 

We have also the following characterization of the processes with independent 
increments within a the of MPR processes. In fact within the considered class of 
Markov processes we can slightly generalize the notion of 'independent increment 
property' and introduce the notion of independent increment property of order N if 
for all < n < N : E((X t — X s ) n \F< s ) is non-random i.e. is a.s. surely a constant. 

Proposition 2. Let X be a N-TLI, N-MSC and N-MPR. Then E((X t - 
E(X t \ J-< s )y | J-< s ) does not depend on X s for j = 1, ...,N iff for every N > n > 
and t > s : 



j=0 ^ 7 fe=0 



7n-y-M)(M)7i,o(M)- 



Proof. By our assumptions we have : E(X t \J-< s ) = r ) 11 (s,t)X s +7io( s jO- Fur- 
ther E(Xt — E(Xt\F<s)) n \F< s ) being a polynomial in X s by our assumptions is a 
constant polynomial. Conversely if this property holds for all n < N then X t — 
E(X t \F< s ) is independent onJ< s of order N. Hence let us (E(X t -E(X t \ -F< s )) n | F< s ) 
denote r y nQ {s,t). We have: 

E[X?\F< a ) = E((X t -E(X t \T< s )+ 7l)1 X s + llfi r\F< a 



j=0 ^' 3=0 XJ/ fc=0 

fn — fc^ 

l7n-m-fc,o7l,Q- 



fc=0 v 7 j"=fc VJ 7 fc=0 v 7 ro=0 



□ 



As a corollary we get the following characterization of processes with independent 
increments. 
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Corollary 4. Let X be a TLI, MSC and N-MPR. Then for X t - X s to be inde- 
pendent of T< s of order N it is necessary and sufficient that for every N > n > 
and t > s structural matrices V n (t) = [vij(t)] where 

( if i<j 
v%,j (*) = < 1 if i=3 . 
{ */ ' '3 

where gk is some continuous function oft. Moreover there exist N polynomial mar- 
tingales (v- 1 (t)xi n \j 7 <t ) ,n = l,...,N. 
V - J tei 

Proof. Is shifted to Section HI □ 

Example 1. As an example consider n = 1 and assume that the process X is 
such that Vi G / : EX t = i.e. in our terminology mi(t) — for all ( £ J. 

Then from \2.$ considered for n = 1 we get Ai(t,s) = ^ ?, \ • Since 



Ci(M) 



1 

EX t X s 



1 

EXl 



7 M (M) 
Moreover we know from 



and Mi(s) : 

Proposition^ Hi) that i(s,t) — for some function v. Thus we see that then 
(X t I 'v(t) , F<t)tei is a martingale. 

Example 2. Now let us assume that process X is stationary in wider sense of order 
N i.e. we will assume thatVt G / : EX 3 t +k = JTiy+fe, cov(X^,Xg) = Cj t k(\s — t\) for 
all j,k = 0, . . . , N , where Cj.k are some functions of one variable only. Following 
arguments used in the theory of (weakly) stationary processes one can easily prove 
that functions Cjj (.) must be positive definite. now takes the form 

[ C J,fc(* ~ S )W>,...,n = A n { S ,t)M n , 

from which it follows that A n {s,t) = A n (t — s) which confronted with Proposition 
\j\iii) leads to the conclusion that 

A n (t - s) = exp((t - s)A„) 

for some lower-triangular n x n matrix A„. It is easy to notice that A n (Ti)A n (j2) 
= A n (T2)A n (r\) hence there exist N (polynomial ) martingales (T n (t), J r <t), where 
T n (t) - exp(-A n i)X t (,l) , n < N. 

Example 3 (q— Wiener and (a,q)— OU processes). Let us consider now two related 
processes that are generalizations of Wiener (or Brownian motion) and Ornstein- 
Uhlenbeck processes. They were first defined and described in 2 as a side result 
of some noncommutative probability considerations. In [3], [4] the discrete version 
of (a,q)—OU process appeared and in [5] q— Wiener process appeared again as a 
side result of considerations concerning quadratic harnesses. More recently in more 
detail these processes were described in [16] . To describe their properties briefly 
and also to illustrate assertions of Theorem^ we must recall some facts concerning 
q— Hermite and Al-Salam-Chihara polynomials and densities with respect to which 
they are orthogonal. To do it swiftly let us introduce the following notation. 

Assume that —1 < q < 1. We will use traditional notation of the q— series theory 
i.e. [0], = 0, [n], = 1 + q + . . . + q n ~\ [n}\ = Uti W, - ^ [0],l = 1, = 



[n-kU[k] a 



n 



> k > 



, oth 



erwtse 
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It will be also helpful to use the so called q—Pochhammer symbol defined for n > 1 

by- (a;q) n = U7=q (! ~ ac f) > mth ( a -l)o = 1 > ( a i> a 2, • • ■ , a k ; q) n = JlLi ( a ^<l)n- 
Often (a; q) n as well as {a\ , a%, . . . , a k ; q) will be abbreviated to (a) n and (ai , a%, . . . 

if it will not cause misunderstanding. 

In particular it is easy to notice that (q) n = (1 — q) n [n] ! and that 



(<?) ™ n > k > 



, otherwise 



ik\q : 

Let us remark that [n] 1 = n, [n]^. — n\, [ 7 ^] 1 — (^), (a; l) n = (1 — a) n and [n] 



{ 



1 if n > 1 , , , , rm •. i r,\ f 1 if n = 
„ , ~ , \n n ! = 1, \ : L = 1, (a;0)„ = < , . , . Now let us 

if n = ' 1 10 ' LfcJo [ 1 - a if n > 1 



introduce the q—Hermite {H n (x\q)} n> _ 1 polynomials. They satisfy the following 
3— term recurrence 

(2.6) H n+1 (x\q) = xH n (x\q) - [n] q #„_i (x) , 

with H-i (x\q) = 0, Hi (x\q) = 1. Let us also introduce the so called Al-Salam 
Chihara {P n } n >_i polynomials. Those are polynomials satisfy the following 3— term 
recurrence: 

(2.7) P n+1 (x\y,p,q) = {x- pyq n )P n (x\y,p,q) - (1 - p 2 q n ~ 1 )[n] q P n - 1 (x\y, p, q), 

with P-i (x\y,p,q) = 0, Po (x\y,p 7 q) = 1. The polynomials {P n } have nice proba- 
bilistic interpretation see e.g. [?]. 

Let us only remark supporting intuition that H n {x\l) = He n (x), where He n 
denotes so called 'probabilistic' Hermite polynomial i.e. one orthogonal with respect 



to measure exp(-x 2 /2)/v/2tt. Similarly P n (x\y,p, 1) = He„(^^=)(l - p 2 ) n l 2 . 

It is also known that polynomials H n and P n are respectively orthogonal with 
respect to the following measures with the densities: 



fN (x\q) = ^""f^- 2 n (a + g fc ) 2 - a - g)*V) ^ (») . 

°° (l-p 2 <? fe ) 

w/iere 5(g) = [—2/^/1 — g, 2/Vl — gj if q < 1 and R for q = 1, (x, g) = 
(1 - pV*) 2 - pg fe (l + p 2 q 2k )xy + p 2 q 2k (x 2 + y 2 ). 

Now (a, q)— OU process it is a stationary Markov process with /jv(-|<z) as Us 
stationary distribution and / CA r(.|y, exp(— a(t — s),q) as its density of transition 
distribution i.e. P(X t e A\X S = y) = fg/ q \ fcN(x\y,exp(—a(t — s),q)dx. 

q— Wiener process is obtained from (a,q)—OU process by time transformation. 
More precisely let Y be given (a,q)—OU process. Let us define: 

(2.8) X = 0; Vr > : X T = V^Y iogr/2a . 

Process X = {X T ) T>0 will be called q— Wiener process. To see examples of matrices 
structural matrices V n (t) of these processes that are defined by these processes let 
us recall some of their properties. 
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Let Y and X be (a,q)—OU and q— Wiener processes respectively. For Vrt > 1, 
!,s€l,,r>(r>0 and < q < 1 we have almost surely: 



E{H n {Y t \q)\F< s ) 



e- na ^H n (Y s \q), 
a n ' 2 H n {X a /^\q). 



From these two relationships remembering that first 4 q—Hermite polynomials have 
the form: Hi(x\q) = x, H 2 (x\q) = x 2 - 1, H 3 (x\q) = x 3 - (2 + q)x, Hi(x\q) — 
x 4 — (q 2 + 2q + 3)x 2 + [3] q we get the following structure matrices of these two 
processes. 

(a,q)—OU process has the following structural matrix V§{t) = exp(iAs), where: 

























a 











A 5 = 


-2a 





2a 













-2{2 + q)a 





3a 







-2(1 -q 2 )a 





-2(3 + 2q^ 


-q 2 )a 


4a 



Notice that for q = 1 we obtain the structural matrix of the ordinary Ornstein- 
Uhlenbeck process. Besides in accordance with Theorem^ we must have commuta- 
tion of structural matrices for n > 0, since for all n (e nat H n (Y t \q) , J r <t)*eR is the 
martingale and diagonal elements of structural matrix (equal to exjp(nta)) are all 
different. 

For the q— Wiener process similar property will not be true. V$(t\q) is given by 
the following formula: 



V 5 (t\q) = 



1 



t 



(3 + q)t 2 





1 



(2 + q)t 




(3- 






1 



2q- 



q 2 )t 



By setting q = 1 we get structural matrix of classical Brownian motion which has 
independent increments 

Remark 1. Notice that one cannot deduce that for the process as the one analyzed 
in last example there exists a reversed martingale. We could deduce this if the sta- 
tionarity assumption would hold for all n. Then since we deal with the distributions 
determined by moments we would deduce that transitional distribution depends on 
the time distance and one dimensional distribution does not depend on t. Hence we 
deal with real (strong) stationarity. 



3. Markov processes with orthogonal martingales 

Now let us assume that our process X is TLI, MSC, MPR and there exist a 
family of polynomial martingales that additionally are orthogonal with respect to 
one dimensional distribution. More precisely let us assume that \/t E I there exist 
a family of polynomials {Pn{-]t)} n>0 such that p n (x]t) is a polynomial of order n 
in x and moreover that 



(3.1) 
(3.2) 



Ep n (X t ;t)p m (X t ;t) = p n (t)6 

Eip^X^t^Ks) = p n (X s ;s)a.s. 
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Recall that such process possessing sequence of orthogonal, polynomial martingales 
i.e. TLI, MSC, MPR processes such that conditions (|3.1|) and (|3.2j) are satisfied 
will be called for brevity OPM class (of Markov processes) . 

To express these conditions in terms of the notions that we have introduced above 
let us assume that our process has family of structural matrices {V n (t)} n>i teI . We 
have the following simple observation: 

Proposition 3. Assuming that X is OPM process with structural matrix {V n (t)} n>1 
A necessary and sufficient for the existence of the family of orthogonal polynomial 
martingales {Pn(-',t)} n>0 is the existence of a family of diagonal matrices J n (t) 
such that Vs, t £ I, n> 1 : 

(3.3) V n (t)D n (s)J n (t) = V n (s)D n (t)J n (s) 

where V n (t) denotes structural matrix of the process and matrix D n {t) is defined by 
the Cholesky decomposition of the moment matrix i.e. by M n (t) = D n (t)D^(t). 

Example 4. To see examples of such processes let us recall the example with 
strongly stationary processes, i.e. Example^ As we know V n (t) = exp(tA n ) for 
some lower-triangular matrix A n . Since matrices V n (t) and A n share the same 
eigenvectors we deduce that matrix V n (t) can be decomposed in the following way: 
V n (t) = G n P n (t)G~ for some lower-triangular matrix G n and a diagonal matrix 
P„. Now since our process is assumed to be stationary its one- dimensional distri- 
bution does not depend on t and consequently moment matrix does not depend on t 
so matrices D n in its Cholesky decomposition does not depend on t. Consequently 
condition iS. 3\) can be reduced to the existence of the family of diagonal matrices 
J n (t) satisfying: 

G n P n (*) G~ x D n J n (t) = G„P„(s)G,; 1 I?„J„( s ). 

One of the possible necessary conditions for the above equality to hold is the condi- 
tion that matrix G~ x D n is diagonal. Then one could select matrix J n (t) = P^(t). 
One can notice that (a,q)—OU process analyzed in Example^ is an example of 
Markov process having orthogonal polynomial martingales. 

Hence let us concentrate on OMP process for which there exist a family of 
orthogonal polynomial martingales p n (X t ;t) i.e. for every n and s < t conditions 
(|3.ip and (|3.2[) are satisfied. To proceed further let us assume that both one- 
dimensional and transitional distributions of our process have the same support 
and moreover transitional distribution is absolutely continuous with respect to the 
marginal one. 

Returning to notation from the beginning of the paper let /i(.,£), t € / denote 
one-dimensional distribution and let rj{.,t\y, s), t, s £ I, t > s, y € supp(/x(., s)). 
In terms of polynomials p n we have for Vn > 1, s < t 

J p n (x;t)/i(dx,t)dt = 0, 

J p n (x;t)rj(dx,t,y,s)dt = p„{y;s) a.s. 

Let us also introduce functions p n (t) defined 

Ep 2 n (X t -t) =p n (t). 
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Recalling theory of martingales we see that functions p n (t) are the so called square 
brackets of martingales p n (Xt\ t). We need only one property of them, namely that 
functions p n {t) are non-decreasing and of course positive. 

Further, unless otherwise stated we will assume the following condition to be 
satisfied by these densities: 

Condition 1. Assume that Vi, s € I, t > s, y € supp fi(., s) : r)(., t, y, s) << t) 
and let 4>{x,t;y,s) denote Radon-Nikodym derivative Suppose 

J {^{x,t;y,s) f^{dx,t) < oo, 

for all s < t and y € supp /(., s). 
Theorem 2. Assume Condition^ then: 



(3.4) rj(dx,t,y,s) = n(dx,t) V —-rp n {x,t)p n (y,s). 

The convergence is in L/2(t). 

Proof. First of all let us denote by {r n [x, t, y, s)} n> _ 1 the family of polynomials 
that are orthogonal with respect to the measure rj(., t; y, s). Let us denote by {7^ „} 
the family of 'connection coefficients' of polynomials {p n (x, t)} in {r n {x, t, y, s} , i.e. 



p n {x, t)=^T l k , n r k {x, t, y, s) 



k=0 

Since we have Vn > 1 : J r n (x, t, y, s)rj(dx, t, y, s) = and J p n (x, t)rj(dx, t, y, s) = 
Pn(Vi s) we deduce that 7o „ = a n (y, s). Hence following the idea of generalization 
of expansion of the ratio of two densities (Radon-Nikodym derivative in the case 
of continuous measures) presented in [TS] we deduce that (|3.4p is true. □ 

We have immediate corollary. 
Corollary 5. Under assumptions of Theorem^ for n > 1, s < t we have : 

E{p n (X s -s)\F >t ) = P^- Pn (X t ;t). 

Consequently {p n (X t ; t) / p n {t)\ F>t} is the reversed (polynomial) martingale. 

Proof. First notice that f(y,s)g(x,t,y,s) is a joint density (X s ,X t ) consequently 
s ) J2 n >o ^T(t)P™( x ' t)Pn(y, s) is the conditional density of X s \X t = x. Hence we 
have E(p m (X s ; s)\F> t ) = fp m {y;s)f(y,s)(J2 n >opjt)Pn(x,t)p n (y,sj)dy = ^^p m (X t ;t) 
a.s. . □ 

Let us assume that polynomials {p n (x;t}} satisfy the following 3-term re- 
currence: 

(3.5) xp n (x;t) = a n+ i{t)p n+ i(x;t) + /3 n (t)p n (x;t) +'y n - 1 (t)p n -i(x;t), 

with p_i(x; t) = 0, Po(x; t) = 1. We have the following immediate observations: 
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Proposition 4. i) x = a>i(t)pi(x;t) + /3 (t), hence EXt — (3 (t), pi(x;t) — (x — 

Mt))/ ai {t) 

ii) EXf — a\(t)p{t) + 0^{t), consequently var(X t ) = a\{t)pi (t) . 
Hi) j n _ 1 (t)p n -i(t) — a n (t)p n (t) in particular j (t) = a\{t)p(t). Since Vt G 
I, n > 1 : p n (t) > we deduce that \ft £ I, n > 1 : a n (t)^/ n _ 1 (t) > 0. 

iv) xpx(x;t) = a 2 (t)p 2 (x;t) + P^pi^x; t) +7 (t) hence E(X t p 1 (X t ;t) = 7 (t), 

„ _ (x~/3 (t))( a: -/3 1 (t))- 7Q (t)a 1 (t) 

P2[X, L) — ai (t)a 2 (t) ' 

v) ax{t)pl(x;t) = a 2 (t)p 2 (x;t) + {fi x {t) - /3 (t)) Pl (x;t) + 7o (t) 

Proof, i) follows directly (|3.5p and initial conditions, ii) take square of both sides 
of pi(x;t) = (x — (3 (t))/ai(t) and then definition of p. iii) multiply both sides 
of (I3.5P by p n -i(t) and integrate with respect to f(x,t)dx. Secondly we note that 
Po(t) — 1. v) This is so since xpx(x\t) — a 2 (t)p 2 (x;t) + /3 1 (t)pi(x;t) + 7 (t) = 
( ai (t) Pl (t) + (3 (t)) Pl (x;t) by i). ' □ 

4. Harnesses 

The notion of harness as a special type of the stochastic process was introduced 
by Hammersley in [T^] . Recently it has been so to say rediscovered and is intensively 
studied by Yor, Bryc, Wesolowski, Matysiak and others in [14] , [7], Q], [8], [11]. In 
this chapter we are going to study conditions that are to be satisfied for that MPR 
process to be a harness and also quadratic harness. 

We will use the extended slightly definition of both these classes in order not to 
loose generality. 

Definition 2. A Markov process X = (X t )tei such that Vt € / : E \X t \ r < oo, 
r € N is said to be r— harness i/Vs < t < u : E{X"[\ J- S ,u) is a polynomial of order 
r in X s and X u . 

Definition 3. 1 — harness will be called simply harness while the process that is both 
r— harness for r = 1, 2 will be called quadratic harness. 

Remark 2. Let us notice that every r— harness for r = 1,...,N which is also 
N-TLI and N-MSC is also both N-rMPR and N-IMPR however by no means 
conversely!. 

First let us study harnesses. Assume that 

(4.1) E(jn.(X t ',t)\F B)U ) = A(s, t, u) Pl (X s ; s) + B(s, t, u) Pl (X u ; u) + C(s, t, u) 

a.s. for some continuous functions of s, t 1 u. First of all notice that C must be 
equal zero since Ep\ (X t ; t) — and we get equality = + + C after calculating 
expectation of both sides. 

In the sequel we will denote for simplicity p\{t) = p(t). 

We have the following simple lemma. 

Lemma 1. // an OPM process X = (X t )tei is a harness then: 

p(u) -p(t) 



(4.2) A(s,t,u) 

(4.3) B{s,t,u) 



p(u) -p(s) 7 
p(t) -p(s) 
p(u) -p(s)' 
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Proof. Multiplying (|4.1|) first by pi(X s -s) and then by pi(X u ;u) and integrating 
we get equations: 

1 = A + B, 
p(t) = Ap(s) + Bp(u). 

To get (HH and (O is trivial. □ 

Now let us add assumption that our process has not only orthogonal polynomial 
martingales but also it satisfies Condition [TJ Consequently its transitional density 
is given by (|3.4[) . We have the following theorem. 

Theorem 3. Let X = (Xt)tei be a Markov process with orthogonal polynomial 
martingales {p n (x; t)} n> _ 1 and measures fi(dx,t) and rj(dx,t,y, s) being respec- 
tively one dimensional and transitional distributions satisfy Condition^ Then X 
is a harness iff coefficients of 3-term recurrence \3. 5\) are given by: 



(4-4) (3 n (t) = f3 (t) + b nai (t)+b nlo (t), 

(4.5) a n (t) = a n ai(t) + a n j (t), 

(4-6) 7 n (t) = c n a x {t) + c nlo {t), 

where \ a n .a n , b n , b n , c n , c n > are some number sequences such that bo = bo = 

I J n>0 

— oq — ai — Co = 0, ai = Co = 1 and Vt G n > : a n (t)7„_ 1 (t) > 0. 

Proof. Lengthy proof is shifted to Section [51 □ 

Example 5. //X is the (a,q)—OU process we have (basing on Proposition^ 
p n (x]t) — exjp(ant)H n (x\q). Hence following i2.6\) we have a n {t) — exp(— at), 
7nW = [n + l] q exp(crt), p(t) = 7 (t)/ai(t) = exp(2crf). Thus equation J^.5[ ) is 
satisfied with a n = 1, a n = 0, equation J^.6'| ) with c n — 0, c„ = [n + l] q while 
equation |^.^[ ) with b n — b n = 0. 

Now let us consider q— Wiener process. Recall that now p n (x; t) — t n ^ 2 H n (-^\q). 
Hence a n (t) = 1 for n > 1 and 7 (t) = Pi(t) — var(Xt) = t as it follows from 
Proposition^ Hence J n (t) = [n + l] q t = [n + l] q 7o(t) another words c„ = 0, c„ = 
[n + l] q . 

We will study now conditions leading to the fact that considered process X is a 
quadratic harness i.e. harness and such that E(Xf\J r S! i) is a quadratic function of 
X s and X u . 

In order to simplify calculations first let us find coefficients A, P>, C, D, E, F of 
(depending on s < t < u) of the following expansion 
(4.7) 

E(p 2 (X t ;t)\F s>u ) =Ap 2 {X s ;s)+Bp 1 (X s ;s)p 1 (X u ;u)+Cp 2 (X u ;u)+Dp 1 (X s ;s)+Ep 1 (X u ;u)+F. 

Let us denote for simplicity: 
(4.8) k = (1 + bb + ac), A = (ac - ac). 

We have the following lemma: 

Lemma 2. Let us denote a, a, 6, b, c, c six parameters defined by the conditions 
a 2 (t) = a(t)(a + ap(t)), f3 x {t) - [3 {t) = a(t)(b + bp(t)), 7l (t) = a(t)(c + cp{t)), 
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(a + ap(t))(c + cp(t)) > for all t £ I, where we denoted for simplicity a(t) — ai(t) 
guaranteeing that the analyzed process is a harness. Then 

F = -Bp(s), 

If k = A = then 

p{u)-p{t) ac p{t) -p(s) , . 

A = -j- - B — , C = —— ^ - aBp{s), 

p(u)-p(s) c p(u)-p(s) 

and B can be selected to be any nonzero function of s < t < u and D and E are 
given by below. 

ac\(p(t) - p{s))(p{u) - p{t j) 



If k 2 + X r > 0, then: 



(a-f 


- ap(t))(p(u) - 


- p{s))(p(s)p(u)acK 


+ p(u)acK + p(s)ac(K — A) + 


acre) ' 


(oH 


- ap(s))(p(u) 


- p(t))(p(u)p(t)acK 


+ p(u)acK + p(t)ac(n — A) + 


ock) 


(a-f 


-ap(t))(p(u) - 


- p(s))(p(s)p(u)acK 


+ p(u)acn + p(s)ac(n — A) + 


ock) ' 


(a- 


f ap(u))(p{t) 


--P( s ))(p(*)p( s )«ck 


+ p(s)ac(n + A) + p(t)acK + 


acn) 


(o- 


Vap{t))(p(u) 


— p(s))(p(s)p(u)acK 


+ p(u)acn + p(s)ac(n — A) 4 


■ acn) 



(4.9) 

B = 
(4.10) 

,4 = 
(4.11) 

C = 

and 



(4.12) D = -bB, E = -bBp(s). 

Proof. Lengthy uninteresting proof is shifted to Section |6] □ 

Remark 3. Notice that following Proposition^ we have p2(t) = p(t) ■ Also 

as a consequence of Favard's Theorem we must have (a + ap(t))(c + cp(t)) > 0. 
Further keeping in mind interpretation of p2 (t) as 'square bracket ' of martingale 
P2{Xt]t) we deduce that p2(t) must be non decreasing. If interval I is bounded then 
the only restrictions on parameters o, a, c, c are 

(a + ap{t)){c + cp{t)) > 0, 

a + dp{s) a + ap(t) 

c + cp(s) c + cp(t) 

/or s,t € I and s < t. 

Now suppose that I is unbounded. If I is unbounded from the right and supposedly 
that p(t) is bounded. This would mean that martingale p\{X t ]t) converges to finite 
limit a.s. and in L2- Consequently X t /cti(t) would have a finite a.s. limit. This 
is rather uninteresting case from the point of view of stochastic processes theory. 
Hence let us assume from now on that p(t) is unbounded if I is unbounded from 
the right hand side. Similarly let us assume that p(t) — >■ as t — > — oo that is 
if I is unbounded from the left hand side. We have also ^j(t^^) = &&t2 (t+&t)^ aC • 
Consequently if I is unbounded from the left hand side we must have ac > and if 
I is unbounded from the right hand side we must have ac > 0. 

If ac 7^ then if I is unbounded from the right we must have ac > and 
discriminant, which is equal to 4(a 2 c 2 — aacc) of the numerator must be non-positive 
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which leads to 1 < if ac is non-zero. The last condition also appears in the works 
of Bryc Wesolowski and Matysiak like e.g. [5] (see also Corollary^below). 

We have also the following corollary concerning particular cases: 

Corollary 6. i) If k — and A ^ then we have: 

( P (t) - P (s))(p(u) - p(t)) 



B = 

A - 



C 



a + ap(t))(p(u) - p(s))p(s) 
(a + ap(s))(p(u) - p(t))p(t) 
(a + ap(t))(p(u) - p(s))p(s) ' 
(a + ap(u))(p(t) -p(s)) 



(a + ap(t))(p(u) -p(s))' 
ii) If n ^ and A ~ then 
B = 0, 

(a + ap(s))(p(u) — p(t))(p(u)p(t)ac + p{u)ac + p(t)ac + ac) _ (p(u) — p(t)) 



A = 
C = 



(a + ap(t))(p(u) — p(s))(p(s)p(u)ac + p(u)ac + p(s)ac + ac) (P(u) — p(s)) ' 
(a + ap(u))(p(t) — p(s))(p(t)p(s)ac + p(s)ac + p(t)ac + ac) _ (p(t) - p(s)) 
(a + ap(t))(p(u) — p(s))(p(s)p(u)ac + p(u)ac + p(s)ac + ac) (P(u) — p(s)) 

Hi) Otherwise if k ^ and A ^ then after dividing both denominators and 
denumerators by n we get: 

B _ ac%(p{t)-p(s))(p(u)-p(t)) 



A = 



C = 



(a 4 


- ap(t))(p(u) - 


- p( s ))(p( s )p( u )ac- 


h p(u)ac - 


^p(s)ac^ 


+ ac) 


(o- 


h ap(s))(p(u) 


- p(t))(p(u)p(t)ac- 


h p(u)ac - 


^p{t)ac^± 


+ ac) 


(flH 


- ap{t)){p{u) - 


- P( s ))(p( s )p( u )ac - 


h p(u)ac - 


^ P (s)ac^ 


+ ac) 


(fl- 


f ap(u))(p{t) 


-P( s ))(p( i )p( s )«c- 


\-p(s)ac^ 


^+p(t)ac 


+ ac) 




- ap(t))(p{u) - 


- P(s))(p(s)p{u)ac- 


h p(u)ac - 


f p(s)ac^ 


+ ac) 



A 

K 


(p(t) - p(s j)(p(u) 


~P(t)) 




{a + ap(t))(p(u) - 


-p(s))( P (s)p(u)±- 


\-p{u) - 


f?5 ( s )«_A + |)' 


(a + ap(s))(p(u) 


- p(t))(p(u)p(t)l 


+ p(u) 


+p(t)^ + l) 


(a + ap{t)){p{u) - 


-p(s))( P (s)p(u)±- 


f P(u) - 


+ f) 


(a + ap(u))(p(t) 


-p( s ))(p(t)p(s)l- 


^p(s)- 





If ac 7^ then one can simplify these expressions further by dividing both denomi- 
nators and denumerators by ac and we get: 

(4.13) B 
{AAA) A 



(4 ' 15) ° (a + ap(t))(p(u)-p(s))(p( S )p(u)^+p(u)+p(s)^ + l) 

Corollary 7. In [8] Bryc et al. considered Markov processes X = (X t ) t >o that 
start from zero at zero, are defined on [0, oo). Moreover they satisfy the following 
normalizing conditions: 1) EX t = 0, 2) var(JT t ) = i, cov(X tl X s ) — min(s,£), 
3) E(X t \F< s ) = X s and E{X*\F< S ) = X 2 S + t - s. for all s < t. From these 
assumptions we deduce that pi(x;t) — x, p(t) — pi(t) = t, a±(t) = 1. Moreover 
since p(t) ranges from to infinity and we have conditions : < ct2(t)"/ 1 (t) 
; n + at)(c + ct); < a2 (t) = a + at we deduce that a > 0, ac > 0, ac > and ac + 
ac > 0. Besides we have (basing on our assumptions) 7 1 (i)p(f) = oi2{t)p2{t) which 
leads to relationship: (c + ct)t — P2(t){a + at). If c — then p2(t) could not be 
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increasing. Hence we deduce that c > 0. Thus examining equation f^. 1 3\j - \4- 15\j we 
deduce that there are 3 independent parameters a/ a which Bryc at al. in [8 called 

a, c/c which was called r in and which was denoted —q in [5]. Notice that — — 

l + q in this notation. Besides since p 2 (t) — t< ^+£u > ~ "fe^t * s ^° ^ e non- decreasing 
we get (by calculating derivative) that for all t > : at 2 + 2t + r > 0. Consequently 
that ot > 1. 

TTie remaining parameters are b and b appearing in fa4.12\ ). They are naturally 
related to parameters r\ and 9 that were defined in [8]. Notice by the way that we 
avoided lengthy (it took 3 pages) and troublesome procedure of showing that these 
parameters exist based on the properties of coefficient of the quadratic form defining 
the quadratic harness. There are also some restrictions concerning coefficients b and 

b. They follow observation that EX^p x {X t ;t) = EX? = Pi{t)p{t) = (b + bt)t and 
the fact that EXf > \EX?\ 4/3 . 

Theorem 4. Let X = (X t )t^i be a Markov process with orthogonal polynomial mar- 
tingales {p n (x; t)} n> _ 1 and densities f(x,t) and g(x,t,y, s) of one dimensional and 
transitional distributions satisfying Condition^ Then X is a quadratic harness iff 
3-term recurrence satisfied by polynomials p n is i3.5\) with coefficients a n (t), (3 n (t), 
7 n (t) are defined by J4-<?| ], an d \4-b\ ) °V the system of 6 number sequences 

|a„.a„, b n , b ni c n , c„| that have to satisfy the following system of 5 recursive equa- 
tions is satisfied: 

(4.16) n(aca n+1 a n+2 + a n+1 a n+2 ac - aca n+1 a n+2 ) = (k — X)aca n+1 a n+2 , 

(4.17) K(acc„_ 2 c„_i - acc„_ 2 c n _i + acc„_ 2 c„-i) = (« — A)acc„_ 2 c„-i, 
(4-18) 

K,(aca n+ i(b n+1 + b n ) + aca n +i{b n +i + b n ) - (be - bc)aa n+ i - (ab - ab)ca n+1 ) 
(4.19) = ac((n - \)(a n+1 b n+1 + a n+1 b n ) + n(a n+1 b n+1 + a n+1 b n )), 

(4.20) 

K(acc n -i(b n + &„-i) + acc„_i(&„ + 6„_i) - (be - bc)ac n -i - (ab - a&)cc n _i) 
(4.21) = ac((n - A)(c„_i&„ + c„_i6„_i) + k(c„_i&„ + c„_iS„_i)), 

(4.22) 

K,(ac(d n+1 c n + a„c„_i + b n (b n - b)) + ac(a n+1 c n + a„c„_i + b n (b n - b)) + ac) = 
(4.23) 

ac((n - X)(a n+1 c n + a n c n - X + b n b n ) + K(a n+1 c n + a„c„_i - bb + (b n - b)(b n - &)) 

with initial conditions : a\ — a, a\ = a, b\ = b,b\=b, C\ = c and c\ = c, and such 
that \/t <E I, n > : (a n + a n p(t))(c n + c n p(t)) > 0. 

Proof. Long tedious proof is shifted to Section [5] □ 

Proof. Uninteresting tedious proof is shifted to Section [6l □ 

Example 6. Let us consider three examples. The q— Wiener and (a, q)— Ornstein- 
Uhlenbeck processes described above and the Poisson process. 

Let us start with q— Wiener process. Following what was presented in Example 
[5| we have p n (x; t) = t n l 2 H n (x/\/i). Hence following \2. 6}) we have: 

xp n (x;t) =p n+ i(x;t) +t[n] q p n -i(x;t). 
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Besides p(t) — pi(t) — Ep\{Xt\i) — t. So a n +i(t) = 1 + Ot and thus a n — 1, a n 
= 0. Further j3 n (t) = so b n = b n = 0. Finally 7 n _i(i) = t[n] q , so c n — 0, c„ = 
[n + l] q . Consequently values of parameters are a = at, a = a± = 0, 6 = b = 0, 
c = ci = 0, c — ct — 1 + q, k = I + bb + ac — I, X — ac — ac = 1 + q, k — X = — q. 
Functions A, B, C, E, F are now 

A = (u-t)(u-qt) B _ (1 + g)(t - s)(u - t) 
(u—s)(u — qs) , (u—s)(u — qs) ' 

C = ( t -f- qS \ ,D = 0,E = 0,F = -sB. 
(u — s)(u — qs) 

One can also check that equations I4-17\ ), 14-1$ ), {4- 19) , {4-20]) , \4.2V) are 

trivially satisfied since 6 = 6 = either a = or c = and a n = 0, c„ = 0. To 
check the equation \4-22!) \4-2'J) we have: 

(1 + ?) = (l + q)(-q[n] q + [n+l] q ), 

which is true, hence we deduce that q— Wiener process is a quadratic harness. 

Now let us analyze (a, q)— OW process. Following what was presented in Example 
[3 we have p n (x; t) = exp(nat) H n (x\q) . Hence following \2. 6\) we have: 

xp n (x;t) = e^ at p n+ i(x]t) + e at [n] q p n ^i(x]t). 

In particular at{t) = e' at , j Q (t) = e at . Besides p(t) = pi(t) = Ep\{X t ;t) = e 2at 
— 7 (i)/ai(t). Following equations &4-4\ ), i4-5\ ) an d i4-°V we have a n+ i(t) = e~ at 
= lai(t) + 07 (i) so a n = 1 and a n = 0, 7 n _i(i) = e at [n] q = 0at(t) + [n] q j (t), so 
c n = and c n = [n + l] q . Of course like before b = b = b n = b n = 0. Functions A, 
B, C, D, E, F are now 

( e 2 «« - e 2at )(e 2au - qe 2at ) (1 + q)(e 2at - e 2as )(e 2au - e 2at ) 

^2au g2as\ f^2cxu gg2as^ ' f^2a.u g2asWg2o;it gg2as^ ' 

C = q -^A, D = 0, E = 0,F=-e 2as B. 

Like in the case of q~ Wiener process equations \4-10) , \4-l r ty , \4-lty , i4-l^]) i 
\4.2Cfy , \4-21ty are trivially satisfied since 6 = 6 = either a = or c = and 
a n = 0, Cn = 0. Equation \4-22§ ^4-23$ has the same form as in the q— Wiener 
process. Hence we deduce that (a,q)—OW process is a quadratic harness. 

Let us now turn our attention to the Poisson process with parameter fi. Following 
[13] (section 1.12) we deduce that p n (x;t) = (—fj£) n C n (x; fj,t), where C n denotes 
Charlier polynomial as defined by (|13j. 1.12.1). Moreover following |13) . (1.12.4) 
we have 

xp n (x;t) =p n+1 (x;t) + (n + fd)p n (x;t) + np,tp n ^(x;t). 

Besides following |13] ( 1.12.2) we deduce thatp{t) = p\{t) = Xt. Thus parameters 
are the following: a = 1, a = 0, 6=1, 6 = 0, c = 0, c = 2, n = I, A = 2 since 
parameters b and b are defined by /3 X (t) — /3 (t) — b + bp (t) . Following equations 
\4-4ty > &4-5\ ) an d \4-®i we have a n +i(t) = 1 + O^t, /3 n (t) = n, 7 n _i(i) = npi and 
thus consequently a n = 1, a n = 0, b n = n, b n = 0, c„ = 0, c n = n + 1. Functions A, 
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B, C, D, E, F are now 

2(u-t)(t-s) 
(u — s) 2 ' 

-B, E = -sB,F = -sB. 

Thus we deduce that Poisson process is a harness. As far as the property of being 
a quadratic harness is concerned we deduce that equations \^.lb^ , \4. 18ty , 

\4 ■ 1 Sty are trivially satisfied since either a = or c = 0, a n = 0, c n = 0. As far as 
equations \4.2U\ ), is concerned we on the left hand sides we have 2n(n — n+l) 

while on the right hand side we get 2n. Finally equation l{4-23ty leads to the 

following identity: 2 = 2(— n + n + 1). hence we deduce that process {Zt} t>0 is a 
quadratic harness. This confirms result of [8] . 

5. Open problems and remarks 

Quadratic harnesses have been defined for square integrable processes. However 
majority of examples (e.g. in [7], [5], [IT], [5], [§]) deal with quadratic harnesses 
that have all moments and belong to the class OPM. Recently in [TU] the authors 
showed that there exist quadratic harnesses that do not have all moments. 

There is an immediate interesting question are there 2— harnesses that are not 
harnesses? Or more generally are there r + 1— harnesses that are not 1 — harnesses? 

At first sight it seems that yes but I do not know any examples. 

Recalling Theorem [3] we notice that condition of being a harness defines 6 num- 
ber sequences {a n , a n , b n , b n , c„, c n } n >i. Further little reflection shows that being a 
harness and r— harness would require more and more equations to be satisfied by 
the same number of 6 parameters sequences . When r was equal 2 we had 5 condi- 
tions, and generally for any r we would have 2r + 1 conditions to be satisfied by 6 
number sequences. Hence to be a r— harness would be more and more difficult. Are 
there processes that are harnesses for every r £ N (let's call this property as being 
a total harness)? The answer is yes. It turns out that not only classical Wiener and 
Ornstein-Uhlenbeck process are total harnesses but the result presented in |17) . 
Theorem 2. can be interpreted in such a way that also q— Wiener and (a, q)— OU 
processes are total harnesses. 

Are there other total harnesses? Considering as {X t } t>0 the Poisson process 
with parameter say equal to /i, little reflection leads to the conclusion that the 
conditional distribution of X t \X s — k,X u — n for s < t < u is equal to the 
distribution of k + Y where Y ~ Bin(n — k, )> where Bin(n,p) denotes binomial 
distribution with parameters n £ N and p £ [0, 1]. Following well known properties 
of binomial distributions we see that n — th moment of k + Y is a polynomial of 
order at most n of k and n. Hence Poisson process is also a total harness. But are 
they the only ones? What are the necessary and sufficient conditions to be satisfied 
by {a n , an, b n , b n , c„, c„}„>i for being a total harness? 

There is another interesting more general and more difficult question that we do 
not know the answer for. Namely as it follows from Theorem [2] there are at least as 
many OPM processes as there are marginal measures (j,(.,t), t £ I. Another words 
having family fj,(.,t), t £ I of probability measures we have family of orthogonal 
polynomials p n (x;t) and by Theorem [2] we have transitional measure. In general 
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within MPR class we have for alH € / and n > 1 : 

Ep n (X t \t)\F< s ) = q n (X s ;s,t), 

where q n denotes polynomial of order not exceeding n and p n as before orthogonal 
polynomial of marginal distribution ji. In general q n (X s ; s, t p n (X s ; s) suggesting 
that the transitional measure is not determined by the marginal one completely. A 
relationship however exists. What is its nature? Can we describe it? 



6. Proofs 

Proof of Proposition^ i) Consider (|2.2I) . By out assumption matrix C n {t,s) is 
non-singular hence both matrices M„(s) and A n {s,t) must be non-singular. 

ii) By the tower property applied to X™ we have : 

n 

£ 7i ,„M*f = E(x:\F<s) = E{E{X^\F< t )\F< s ) 

3=0 

n n k 

= E(J2 7 fc) „(*' u ) X t\^<s) = E 7*,«(*, «) E 7i,*(», 

n n 

= X t 7i,fc (s, *)7fc,n (*) u ) • 
3=0 k=j 

Comparing respective coefficients we get for k < n : 7 fe „(s, u) = X)j=fc 7fe,j ( s > *)7j,n (*) ' 
Now notice that this system of equations can written briefly in the matrix form: 
^4.„(s,t)Ai(t,w). 

iii) We set say s = in ii) and then by i) we get 

A- 1 (Q,t)A n (0,u) = An(t,u), 

for all t < u. Thus it remains to define V n (u) = A n (0,u). 

iv) First of all let us notice that by MSC assumption diagonal entries of matrix 
A n (s,t) are positive for s sufficiently close to t and s < t. Secondly recall that 
diagonal elements of triangular matrix are equal to its eigenvalues. Thirdly from 
the decomposition (|2 .4[) it follows that the product of diagonal entries of matrices 
V n and V~ x are equal to diagonal elements of An(s, t). Hence we can select diagonal 
entries of V n to be positive at least for s < t close to t. On the other hand since by 
assumption elements of all matrices V n , A n (s, t) are continuous functions of t they 
cannot change sign since all matrices involved are non-singular. □ 

Proof of Theorem [7J Firstly notice that condition (|2.5[) is equivalently to the fact 
that D^ l {t)V^ l {s) = D^ l {s)V^ x {t). Let us define T N {s) = D^\s)X^ N) . Multi- 
plying both sides of (23) by D' 1 ^) we see by (|2.1I) 

E(T N (t)\T< s ) = D N \t)E(x( N) \F< s )=D], 1 (t)A N ( S ,t)xW 

= D N \t)V N H S )V N (t)X^ = D-\s)V^(t)V N (t)XW = Tn (s). 

Conversely say (TV(i), J-<t) is a martingale. By the assumed martingale struc- 
ture of Tjv we deduce that there exists a N x N matrix -Djv(t) such that TV(i) 
= DjftyX^. On one hand we have E(T N (t)\T< s ) = D^^EiX^lT^) 
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= D N 1 (t)V N 1 (s)VN(t)Xs N \ On the other (by martingale assumption we have) 
E(T N {t)\T< s ) = D N \s)X { s N) . Hence we have 

D-\t)V^(s)V N (t)X^ = D^( S )XW 

almost surely. Since support of Xg ^ contains infinite number of points we deduce 
that Djj 1 (t)V^ (s)Vn (t) = -D^y^s) for all t > s. This inequality is equivalent to 

(USD- 

Now let us suppose that all diagonal entries of matrix VAr(i) are different. We 
have to show that D^it) = VaK*)- First of all notice that equality that D^ 1 (t)V^ 1 (s)Vn (t) 
= Djf (s) can be multiplied by a non-singular matrix with entries that do not de- 
pend on t or s hence matrix D is only defined up to multipliers of the diagonal. Sec- 
ondly this matrix equality is equivalent to the equality VN{t)D N (s) — D N (t)VN(s). 
Further notice that since all matrices Vjv(t), Vn(s), D^it) and D/v(s) are lower tri- 
angular we deduce that Vj, i(t)dn(s) = u$ j(s)djj(t) for i — 1,...,N. Hence we can 
select without loosing generality di,i(t) = Vi.i(t) for t £ I and i = 1, . . . , N. Now let 
us notice that i + entries of matrices VAr(i)-Djv(s) and -Dat(£)Vat(s) are respec- 
tively Ui+i,i(t)uj,i(s) +«i+i,j+i(t)di+i,i(s) and d l+ i^(t)vi^(s) + Vi+i,i+i(i)uj+i,i(s). 
Equality of these two quantities implies that 

US A M ,^ Vi+l,i( s ) - d i+lA s ) 

Vi,i(S) 

First of all we notice that since the left hand side does not depend on s so must 
be the right hand side. Consequently -^•+i.'( s ) mus t k e equal to a constant 

say m,i. Dividing both sides of the above equality by Vi+i^+i it) we see that 

ViAt) 

7T m i = m i- 

Vi+l,i+l[t) 

By our assumption rnj must be equal to zero and consequently we have di+iA^) = 
Vi+iAt) for t <G I and i = 1, . . . , N — 1. 

Now let us consider i + 2, i entries of these two matrices. On one hand they 
are equal to respectively Vi+2 : i(^H,i( s ) + Vi+2,i+i (t)d i+1 As) + Ui +2 ,i+2(*H +2 ,i(s) 
and d i+2 ,i(t)«i,j(s) + d i+2yi+1 (t)v i+1:i (s) + u i+2 ,i+2(*M+2,i(s) again since we have 
shown that d i+M (i) = v i+lyi (t) we deduce that Vi +2 A t ) v iA s )+ v i+2,i+A t )di+2A s ) 
= d l+ 2,i(t)v i}i (s) + v i+ 2a+2(t)vi+2,i(s) for all t £ I and i = 1, . . . , N — 2. That is 
similar situation as in the case i + Thus we deduce that di+ 2 ,i{s) = 1^+2, i(i) 
for all i and t. And so on we deduce that = Vj t i(t) for all t € I and N > j > 

i > 1. □ 

Proof of Corollary From (|2.4I) it follows that 

(6.1) VAs)An(s,t) = VAt) 

and we know from Proposition [2] that: 

E(X?\F< S ) = £ (^Tn-i.oM)**, 

since in this case r y 1 i(s,t) = 1 and r y 1 o(s,t) — 0. Hence the th entry of the 
matrix A n must be of the form Q)7 n _j.o( s ! t) where 7 n _j,o ^ s its (* — 3i 0)— th entry. 
Let us denote 7fco( s '0 7fc( s >0 f° r brevity. Besides th entry of this matrix is 
equal to 1. Assuming that diagonal entries of matrix V n (s) are also 1 we have to 
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show that Vij(t) — \j)gi-j(t) for i > j for some functions gk(t). Secondly notice 
that i, j—ih entry of the matrix equation (16.11) takes the form 

Taking j = i — 1 we see that ^(s, t) = Wi.i-i(i) — Vij-i(s). Since 7i(s, t) = 
v i,o(t) — vi t o(s). Let us denote i>i,o(i) = 9i{t)- Hence we have proved that i>i,i-i(t) 
= Further proof is by induction. Hence assume that Vi^-j(t) — Q)</j(i) 

for j < to. Let us take j = m + 1. We have by the induction assumption: 

«<,i-m-l(»)+ I] J L^J^WWllM) 



k=i—m 



fc— i— m 

TO + 1 



\m + 1/ \m — s/ 

So Wi ! i^ m _n(s)/ ( m l J does not depend on i. So let us denote v m +i.o( s ) = ff m +i(s). 
Consequently u^-to-i (s) = ( m l +1 ) g m+1 (t) . 

To show that V~ 1 {t)x[ n ^ is a martingale we have to show (by Theorem [1} that 
for example matrices V n {t) and V n (s) commute. Let us thus calculate i, j— th entry 
of the product V n (t)V n (s) : 

Y^v i>k (t)v k j{s) = ( 1 j ( k ) g t - k (t)g k -j (s) 

k=j k=j V / V-^ 



)) £ (i_jJf*-*(*)5*-i(«) 

j 



XI , )fi-j- s (*)ff s (s)- 



s=0 

Now it remains to notice that X)»=o ( l ~ s j )9i-j-s(t)g s (s) = Y,l=o ( l ~ s j )9i-j-s(s)g s (t). 

□ 

Proof of Proposition^ Let us write (|2.5|) in an equivalent form: J J! ~ 1 (s)Z?~ 1 (s)V' n ~ 1 (t) = 

First let us assume that moment matrix M„ has Cholesky decomposition with 
matrix D n satisfying ()3.3|) . Let us define p n (X t ;t) = J~ 1 (t)D~ 1 (i)X t ^ sequence 
of polynomials. We have: 

E{ Vn {X t -t)\F< s ) = J-\t)D-\t)Ms,t)X^ = J;\t)D-\t)V^s)V n {t)X<?> 
= J- l (s)D- 1 (s)X^=p n (X s ;s). 

Besides we have 

Ep n (X t ;t)pT(X t ;t) = J~ 1 (t)D- 1 (t)M n (t)(J- 1 (t)D- 1 (t)) T = J- 2 (t). 
Hence indeed polynomial martingales p n (X t ;t) are also mutually orthogonal. 



QUADRATIC HARNESSES 



21 



Hence let us assume now p n (X t ;t) = F n 1 (t)X < j. n ^ 1 is a orthogonal polynomial 
martingale. Thus we have: 

F- l {s)X<f) = p n (X s ;s) = E( Vn {X t -t)\F< s ) = F-\t)A n {s,t)X^ = F-\t)V-\s)V n (t)X^ . 

(n) 

By assumption support of random vector X$ is infinite thus we must have 
(6.2) F- 1 (s)=F- 1 (t)V- 1 (s)V n (t). 

Further have Ep n (X t ; t)p^(X t ] t) = F- x (t)M n (t)(F- x (t)) T and by assumption 
the last matrix is diagonal. Since matrix M„ is positive definite we deduce that it 
has Cholesky decomposition M n (i) = D n (t)D^(t) with D n being lower-triangular. 
Consequently we have F~ 1 (t)D n (t)(F~ 1 (t)D n (i)) T = P n (t) where P„ denotes 
some diagonal matrix with positive entries. Since Cholesky decomposition is unique 
we deduce that D~ 1 (t)i 7, „(<) = y/P n (t) where y/P n {t) denotes diagonal matrix 
with entries that are square roots of entries of matrix P n (t). Consequently F n (t) 
— D n (t)y/P n (t) and condition ()6.2j) with so defined F n is equivalent to condition 

icra. □ 



Proof of Theorem\3\ First let us notice that h(x, t\y, s, z, it) — g ( x ' t ^ s ^ g ( z ^"' a: ' t ) j s 
the conditional density of Xt\X s = y, X u = z for s < t < u. Let us find E(X t \X s = 
y,X u — z). We have using (|3.4j) : 

h(x, t\y, s, z, u) = — -f{x;t)f(z;u) V - 1 p j (x;t)p j (y,s)p k (z;u)p k (x;t). 

g{z,u,y,s) jj^aPiWPkW 

To perform our calculations swiftly let us notice that from (13.5[) it follows that we 
have expansion 

(6.3) px(x;t)p n (x;t) = a n+1 (t)p n+1 (x\t) + /3 n (t)p n (x;t) +%-x(t)p n -i{x;t), 

where a n+1 (t) = a n+ i(t)/ai(t); $ n {t) = (p n (t)-f3 (t))/ai(t); 7 n _ 1 (t) = 7„-i(*)A*i (*)• 
So we have 



E{p 1 {X t ;t)\X s = y,X u = z) 



En>oP«( Z ; U )Pn(V, s)/p n {u) 

52 - U }~ i ■, Pj(y,s)p k (z;u) I ' p 1 (x;t)p j (x;t)p k (x;t)f(x,t)dx 



j,k>0 



T,n>oPn( Z '> U )Pn(y> S )/Pn( U ) 

^2 p (t)p k (u) P ^ y,S '' Pk ^ Z;U '' J ^i+^i+^^+PA^Pi&^+l 
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Let us calculate 



x / (&j + ip j+ i(x;t) + /3 J (t)p J (x;t) + A f j _ 1 (t)p j ^ 1 (x;t))p k (x;t)f(x,t)dx 

= -"^w^ \ Pk-i{y\ s)p k (z; u) + ^ K( l )Pk{y, s)Pk(z; u)/p k (u) 
k=0 Pk-i[t)p k {U) k=Q 

, Pk{t)l k {t) , > , w . , > 
+ — : T^-Pk+i{y,s)Pk{z;u)/pk{u). 

Now using Proposition S] iii) and definition of functions a n (t) , 7 n (t) and $ n (t) 

we have: ^TTOT = K-ImkmZ) = W and similar1 ^ fOT other coefficients: 

f 



B(pi(X t ;t)|X a =i/,X u = z) 



x $^(7A-i(*)P*-i(y; s ) +K{ t )Pk{y-,s) + a k +i(t)pk+i{y, s))p k (z;u)/pk(u). 

k>0 

Now by assumption that X is a harness we must have the following equality: 
5^(7fc-i(*)Pfc-l(j/; s) + j3 k (t)p k (y, s) + a k+1 (t)p k+1 (y, s))p k (z; u)/p k (u) 

k>0 



A(s, t, u)^2p n (z; u){a n+1 (s)p n+1 (y, s) + (3 n (s)p n (y, s) + J n -i(s)p n -i(y, s))/p n {u) 

n>0 

+B(s,t,u)^2(a n+1 (u)p n+1 (z,u) + j3 n (u)p n (z;u) + 7 n _i(u)p„_i(«,u))p n (j/, s)/p n (u). 

n>0 

Let us multiply both sides of this equality by p m (z;u) and integrate with respect 
to f(z, u)dz. We will get 

(7 m -l(*)i>m-l (V, s ) + /? m (*)i>m s ) + &m+l (t)Prn+l(y, s)) 

+B(s ) t,u)(a m (u)p m -i(y,s)p m (u)/p m -i(u) + f3 m (u)p m (y; s) + j m (u)p m +i(y, s)p m {u) /p m+1 (u)) 

Taking into account Proposition [4] iii) and uniqueness of expansion in orthogonal 
polynomials we get the following equations 

(6.4) p n (t) = A(s,t,u)p n {s) + B(s,t,u)p n {u), 

(6.5) 7m-i(*) = ^( s >*)")7m-i( s ) +- B (s,t,u)7 m _i(w), 

(6.6) a m+ i(t) = A(s,t,u)a m+ i(s) + B(s,t,u)a m+ i(u), 

where {a n (t), P n (t), 7„(i)} are the coefficients of the modified 3-term recurrence 
(|6.3|) satisfied by polynomials {p„} and functions A, B are given by (|4. 2|) and (|4.3[) . 
To find functions @ n (t), a n (t) and 7„(i) satisfying equations ()6.4[) - (|6.6[) we will use 
the following auxiliary result: 

Lemma 3. Let g(t) be some nonzero, monotone continuous function and suppose 
that continuous function f(t) satisfies functional equation 

fM 9{u) - g{t) (l s , g(t) - g(s) 

g(u) - g{s) g{u) - g{s) 
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Proof. Since sM^ittl i 9(t)-g(s) = i we nave IMtdisl = f( u )-fW Hence /(M) ~ /(t) 
J ' s(«)-s(s) s(s) g(«)-s(f) ' 9(«)-s(*) 

does not depend on it. Hence /(u) = n(t)(g(u) — g(t)) + f(t). Taking two different 

values of f say ii and £2 we get: = (77(^1) — 77 (t 2 ))g(u) + C(ti,t 2 ) for all u. Since 

<7(u) is not constant we deduce that 77 (ii) = 77(^2 ) and that C(ti, t 2 ) — which leads 

to conclusion that — rj (ti) g(ti) = /(te) — 77 (£2) 5(^2)- Both these conclusions 

lead to linearity of fit) with respect to g(t). □ 



Now recall that A(s, t, u) = ^J, u ) ^S 1 } and Bis, t, u) = p( s ) Hence we imme- 

V ' ' / piu) — p(s) ^ 5 ' / piu) — p(s) 

diately have: 



/3 n (t) = 6„ + 6„p(i), 7„(t) = c„ + c n p{t), a n (t) = a n + a„p(t). 
Now it remains recall definitions of coefficients a, $, 7. □ 



Proof of Lemma\M Now let us consider expression for E(p 2 (X t ;t)\J r SiU ) . On the 
way we will use the following notation: 

(6.7) p 2 (x;t)p n (x;t) = r 2 . n+2 (t)p n+2 (x;t) +ri, n +i(t)p n+ t(x;t) 

(6.8) +r 0tn (t)p n (x;t) + r-i in -i(t)p n -i(x;t)r-2 jn -2(t)Pn-2(x;t), 
(6.9) 

pi(x;t)p n (x;t) = vi tn+ i(t)p n+ i(x;t) + v a . n (t)p n (x; t) + v- ltn -i(t)p n -i(x] t). 



Multiplying both sides of the above expansion firstly by p n _ 2 (x;t) and p n -i(x;t) 
and then integrating we get:and similarly for the second expansion. During all 
calculations we use the following observations that we recall here for clarity of 
exposition. They follow properties of polynomials p n and Proposition [4] For n > 
and (,s6J,s<i<ii: 



Ep n (X t ;t)p m (X t ;t) = p n (t)6 n ,m, E(p n (X t - 1 t)\F< s ) = p n (X s ;s), 
E(p n (X a ;s)\F >t ) = ^ Pn (X t] t), 

Pn{t) 

Epl(X t ;t)p 2 (X t ;t) = ^-p 2 (t), Epf(X t ;t) = ^ " ^ p{t) 
Dixit) a\{t) 

Ep\{X t -t)p\{X s ,s) = 



ai{t)ai{s) 

x(a 2 (t)a 2 (s)p 2 (s) + (ft(t) - MtW^s) - /8 (*))Pi(*) + 7o(*)7o(*)) 
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We will show that coefficients A, B, C, D, E, F satisfy the following system of 
linear equations.: 



(6.10) = F + Bp(s), l = (A + C)+B? 2 ^ 



ai(s) 

(6-11) — 7 -rp(t) = A — —p(s)+C — —p(u) + B — 
a2(t) ct2(s) a 2 (u) a\ 

(6.12) 



= m^M B + (D + E),0= ^ {u) -^ u) Bp(s) + + £*(«), 

ai(s) ai(u) 

(6.13) 

Tift) = ^ 7i(*) + c lM + B( ^hM + WiM ~ PoMWiW ~ PoW) 
ai(t) cxi(s) a.\(u) oti(u)ai{s) a.\{u)oti{s) 

+ p(u)) + D m^m + E m^m + F . 

ai(s) a.i(u) 



In our lengthy calculations we will process formula (|4.7I) which we copy here 
below for the convenience of the reader. 



E{p 2 {X t ;t)\F s , u ) = Ap 2 {X s ;s)+Bp 1 (X s ;s)p 1 (X u ;u)+Cp 2 (X u ;u)+Dp 1 (X s ;s)+Ep 1 (X u ;u)+F. 



To get first assertion of equation (16.101) we get by integrating (|4.T[) . To get the 
second one we multiply (|4.7[) by P2(X S ; s) and integrate. To get (|6.11l we multiply 
(|4.7|) by p 2 {X u ]u) and integrate. To get first assertion of (|6.12j) we multiply (14. 7[) 
by pi(X s ; s) and integrate. To get the second one we multiply (14.71) by pi(X u ; u) 
and integrate. To get (|6.13[) we multiply (|4.7[) by pi(X s ; s)pi(X u ; u) and integrate. 
Next we use identity: a2(t)p2(t) — "f 1 (t)p(t) and ot\{t)p(t) = 7 (i) and then cancel 
out p(s). 

Now following Theorem [3] and Proposition |4] to prove second assertion we have 
to take into account the following facts: 



0i(*)-A>(*) 

a 2 (t) 



6a(t) + &7(t) = 
aa(t) + 07 (i) 
ca(t) + C7(t) = 
7(*) 



Pi(t) = 



a(t)(6H 
= a(i)(& 
a(t)(cH 



- op(t)) 
cp(*)), 



a 2 (t) a(t){aa (t) + aj(t) 



cp(t) 
ap(t) 
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where we denoted for simplicity a(t) = ai(t) and j(t) — Jo(t) and a, a, b, b, c, c 
are some numerical parameters. So equations ()6.10p - (|6.12p now become: 

-7(^ 



F 



A . (c + cp(i)) . „. . 
p(*) 7 I ~ V\ = 



S 7 ( a )a(a), 1 
(c+ cp(s)) 



A + C + B(a + , 



a(s) 







- ap(*) 
D + E 



(a + ap(s)) 
B{b + bp(s)), = 



f Cp(u) 
D P (s) - 



(c + cp(uj) 



Bp(s)(c + cp(u)), 



(a + ap(u) 

- Ep(u) + Bp(s)(b + bp(u)) 
(c + cp(t)) = A(c + cp(s)) + C(c + cp(u)) + L>(6 + Sp(s)) + J5(6 + bp(u)) 

(c + cp(s)) 



-Bp(s) + B((a + ap(s)){a + ap(u)) v " ' T'7( + ( b + + &P») + ?(«))• 

Now notice that 

D(b + bp(s)) + E(b + bp{u)) = b(D + E)+ b(Dp(s) + Ep{u)) 

= -bB(b + bp[s)) - p(s)Bb(b + bp{u)) 

= -B{b 2 + 2bbp(s) + bp{s)p(u)) 

Since the function p(t) is nonzero as a square bracket of the martingale p\(X t ; t) we 
can divide by p(s) the last equation. Further we notice that D(b + bp(s)) + E{b + 
bp{u)) = b(D + E) + b(Dp(s) + Ep{u)) = ~Bb(b + bp(s)) - Bbp(s)(b + bp{u)) = 
-B(2bbp(s) + b 2 + b 2 p(s)p(u)). Further B(b + bp(s))(b + bp(u) - B(2bbp(s) + b 2 + 
b 2 p(s)p(u)) = B(b 2 + bbp(s) + bbp{u) + b 2 p(s)p(u) - 2bbp{s) - b 2 - b 2 p(s)p(u)) = 
Bbb{p(u) — p{s)). Hence our system of 5 equations can be split into two sets: Set 
consisting of three equations satisfied by unknowns A, B, C : 

1 = A + C + B(a + ap(s)), 



P{t) : 



cp(t) 



Ap(s] 



(c+cp(s)) 



Cp(u 



(c + cp(u)) 



Bp(s)(c + cp{u)), 



a + ap(t) rx (a + ap(s)) (a + ap(u)) 

c + cp[t) = A(c + cp(s)) + C(c + cp{u)) + B((p(u) - p(s))(l + 66) + (a + ap(u))(c + cp(s)) 
The other set of two equations that is satisfied by D and E. 

= D + E + B{b + bp(s)), = Dp(s) + Ep{u) + Bp(s)(b + bp(u)). 
The first set of equations yields: 

ac\(p(t) - p(s))(p(u) - p(t)) 



B 



A = 



(a + ap(t))(p{u) — p(s))(p(s)p{u)ac.K - 
(a + ap(s))(p(u) - p(t))(p(u)p(t)acK - 



p(u)acn + p(s)ac(n — A) + acn) ' 
p(u)acn + p(t)ac(n — A) + acre) 



C 



(a + ap(t))(p(u) — p{s))(p{s)p{u)acK - 
(a + ap(u))(p(t) - p(s))(p(t)p(s)acK ■ 



p(u)acK + p(s)ac(n — A) + acn) ' 
p{s)ac{n — A) + p(t)acK + acn) 



(a + ap(t))(p(u) — p(s))(p(s)p(u)acK + p{u)acn + p(s)ac(n — A) + acre) 



where we denoted K = (1 + bb + ac), A = (ac — ac) 

As far as the other system of equations is concerned we have: = D + E + B(b- 
bp(s)), = Dp(s) + Ep(u) + Bp(s)(b + bp(u)) which gives 

D = -bB(s,t,u), E = -bB(s,t,u)p(s) 



□ 
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Proof of Theorem ^ The proof is based on several auxiliary results of which the 
most important is the following lemma: □ 



Lemma 4. Let X = (X t )tei be a Markov process with orthogonal polynomial mar- 
tingales {p n (x; t)} n >_i and densities f(x,t) and g(x,t,y, s) of one dimensional 
and transitional distributions satisfying Condition^ Then X being a harness is a 
quadratic harness iff the following system of equations is satisfied: 



r-2,m-l{t) = Ar- 2 ,m-2{s) + Cr_ 2 ,m-2(«) + fl«-l, m -2(s)«-l, m -l(tl), 

r_i, m _i(t) = Ar_i iTO _i(s) + Cr_i jm _i(u) + B(v , m -i(s)v-i, m -i(u) 
+v-i,m-i(s)v 0tm (u)) + L»t;_i, m _i(s) + £u_i )OT _i(u), 
ro, m (t) = Ar , m (s) + Cro,m(u) + B(v-i, m -i(u)v lim (s) 

+vo, m (u)v , m (s) + Ui, m +i(u)u_i, ro (s)) + Dvo, m {s) + Ev Q , m (u), 
r\,m+i{t) = An t m+i(s) + Cn tm+ i(u) + B(vo, m (u)vi, m+ i(s) 

+Wl : m+l( u ) w : m+l(s)) + DUl. m+ l(s) + £^l, m+ l(tt), 

r2,m+2(t) = Ar 2 , m +2(s) + Cr 2 . m+2 (u) + Bv ltm+2 {s)v lim+ i(u), 



where A, B, C, -D, are defined by I14.9{ I- (J.1S^ and coefficients r,i_j, i — —2, . . . , 2 
, j = m — 2, . . . , m + 2 are defined by \6. 7[)-(HO]). 



Proof of Lemma [^} We have : 



S(p2(Xi;t)|J'»,„) = J- 



E„>oP«( 2; ; u )P"(y^)/P"( u ) 

- 7777 / s Pj(y,s)Pk(z;u) j p 2 {x;t)pj(x;t)p k (x;t)f(x 7 t)da 
j,k>o Pj[T)Pk{u) J 



1 



E„>oP«( z ; u )p™(y' s )/p«( u ) 
^^R^' (y ' sK - (z;M)x 

(r2,j+2ft-+2 + (*)%•+! + r .j(t)pj + r-i,j-ipj-i + r^ 2 j^ 2 p j ^ 2 )p k (x;t)f(x,t)dx. 



QUADRATIC HARNESSES 27 

Now notice that: 



x / (r 2 , 3 -+2jJj+2 + n,j+i(t)pj+i + r 0} n(t)pj + r-ij-ipj-i + r- 2 ,j-2Pj-2)Pk(x;t)f(x,t)da 
r 2 ,k(t)p k (t) . . , . -A r ltk (t)pk{t) / \ { \ 

1^ ~ — m - 7 , Pk-2{y\s)p k {z-u) + > - — r Pfc-i(y;g)Pfc(g;«) 

~ Pk-2{t)Pk{u) ^Pfc-lWPkW 

oo 

+ r o,k{ t )Pk{y, s)p k (z; u)/p k {u) 



k=0 
oo 



r-i }k (t)Pk(t) , . 

Pk{t)r- 2 ,k{t) , , , w . , , 
>. : pis — Pfc+2(y, sftz; u) p k {u). 



Using f|6.14[) we get 



^(pa^t;*)!^) - i — - x 

oo 

C^2(r-2,k-2(t)pk-2(y; s) + r-i,k(t)pk-i(y, s) + r ,k(t)pk{y, s) 

k=0 

+ri,k+i(t)p k +i(y, s) + r 2 , k+2 (t)p k+2 (y, s))p k {z; u)/p k (u). 

Now let assume that E(p 2 (X t ;t)\J r s>u ) = Ap 2 (X s ; s)+Bp 1 (X s ; s)p 1 (X u ; u)+Cp 2 (X u ; u) 
Dpi(X s ; s) + Epi(X u ; u) + F. This implies the the following equality: 

oo 

C^2(r-2,k-2(t)pk-2(y; s) + r-i,k{t)pk-i(y, s) + r a , k (t)p k (y, s) 

k=0 

+ri,k+i(t)pk+i(y,s) +r 2 , k+2 (t)p k+2 (y,s))p k (z;u)/p k (u) = 

= (Ap 2 (y; s) + Bpi (y: s)pi (z;u) + Cp 2 (z;u) + Dpi (y;s) + Ep\ (z; u) + F) 
x ^2Pn(z;u)p n (y,s)/p n (u) = -p(s)B^2p n (z;u)p n (y,s)/p n (u) 

n>0 n>0 

+A ^ Vn ^ Z ( r i r 2,n+2(s)Pn+2{y 1 s) + (s)p n+ i (y, s) + r ,n(s)pn(V, s ) 

n>0 Pn[U) 

+r-l,n-l{s)p n -l(y, s) + r-2,n-l(s)p n -2(y, s)) 

+C Pn } V / ^ (r 2 ,n+2(u)p n+ 2(z, u) + 7*1 n+X (u)p n +l (z, u) 
ri>0 1 y ' 

+ro,„(u)p n (z, u) + r_i, n _i (2, u) + r_ 2 ,n-i('")Pn-2(z, u)) 

+ B ^2 ^-rr( v i,ri+i(s)pn+i(y,s) + v , n (s)p n (y,s) 

n>0 Pn[U) 
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+V-l, n -l(s)Pn-l(y\ s)){vi,n+l{u)p n+ l{z, u) + V . n (u)p n (z, u) + U-l, n -l (u)p n -l (z\ «)) 
+ D ^2 ( v l,n+l(s)Pn+l{y, s) +V ,n(s)p n (y,s) + U-l.n-lOOPn-lfa s)) 



n>0 



; , . (v ln+1 (u)p n+1 (z,u) + v 0n (u)p n (z,u) + v- 1 . n ^ 1 (u)p n _ 1 (z;u)) 

Pn(u) 

n>0 ' 

Now let us multiply both sides of this equality by p m {z\u) and integrate with 
respect to f(z, u)dz. We get: 

(r-2,m-2(t)Pm-2(y, s) + r_i iTO (i)p m _i (y; s) + r , m (t)p m (y, s) 
+n,m+iWPm+ife, s) + r 2 . m+2 (t)p m+2 (y, s)) 
= -p{s)Bp m (y,s) + A(r 2 ^ m+2 (s)p m+2 (y, a) + r^ m+ i(s)p m+1 (y, s) 
+r .rn(s)p m (y, s) + r_i, m _i(s)p m _i(y, s) + r_ 2: m-i (s)p m _ 2 (y, s)) 

. r ,,P m -2{y,s) p m -i(y,s) 

+C(— r^-r 2 m (u)p m (u) + — n" r i,"iW?mM + Pm(y; s)m,m 

Pm-2{U) Pm-lW 

.p m +i(y,s) , w , x . p m +2(y,s) 

H — ; r^T « Pra-l « + — : r ^-r_ 2 , m - 2 (w)p m - 2 (M)) 

Pm+l(«) ' P m +2(U) 

+D{v 1 ^ m+1 (s)p m+1 (y, s) + v 0>m (s)p m (y, s) + u_i, m _i (s)p m _i (y; s)) 

^ Pm-ifas) . , , . . . , . p m+1 (y,s) 

+E(— i—-v 1 . m {u)p m {u) + vo. m (u)p m (y,s) + — 1—- V-i ra -i u)p m _i u 

Pm-lW ' Pm+lN 

+ g ^i,m(«)?m(«) («i, m (s)p m (y; s) + v , TO -i(s)p m -i(y; s) + v_i m _ 2 (s)p m -2(y; s)) 

Pm-l(U) 

+wo,m(w)((wi,m+i( s )Pm+i(y, s) + v ^ m (s)p m (y , s) + u_i, m _i (s)p m _i (y; s)) 

,m+2 ^0,m+l (s)p m +i(y; s) + v- l m (a)p m (y; s)). 

p m +i(u) 

Taking into account (|6.14p and uniqueness of expansion in orthogonal polynomials 
we get the following equations: r_2, n -2(*)Pn-2(*) = ru tn (t)p n (t), r_i,„_i(i)p n _i(t) = 

ri,n-l(t)Pn-l(t), V-i,n-l(t)Pn-l{t) = V hn {t)p n (t). 

Now to solve system of equations given in Lemma 2] we need several following 
technical results. □ 

Proposition 5. Coefficients r and v are related to one another by the following 
formulae: 

r2,n+2(t) = 7wVl,n+l\t)Vi in+ 2(t), ri, n+ i {t) = «i,n+i ( («0,n+l + «0,n) ), 

£22(1) Q?2 «2 

. . .OL\ (3 1 — fir, 7 

ro,n(t) = ( {Vl.n+lV-l.n + V , n V ,n + V-l,ra-l«l,n) «0,« ), 

c*2 a 2 a 2 

"1 / . \ Pi-Pa ,.s "1 
f-Ltk-l t = U-l,n-lC«0,Ti +fO,n-lj V-l n-1, r-2,n-2[t) = U_i n _i«_i „_2. 

a 2 a 2 a 2 

Besides we have: 
(6.14) 

r- 2 , n - 2 (t)p n - 2 (t) = r 2 , n (*)Pn(*)) f-l,n-l(*)Pn-l(*) = ^l,n-l (*)p\i-l (*), «-l,n-l (*)pra-l (*) = «l,n(*)Pn(*)- 
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Coefficients v are related to coefficients of the 3 term recurrence by formulae: 

M Jn-l(f} M (KM U s an+l(t) 
V-l,n-l{t) = 7— , V ,n{t) = 77s- , Vl,n+l(*J = 7TT ■ 

ai{t) ai(t) ai(t) 

Proof. We have: p\p n = pi(v ltn+ ip n+ i+V , n p n +V-i,n-lPn-l) = «l,n+l«l,n+2Pn+2+ 
Vl, n +lVO,n+lPn+l + Vl,n+lV-l,nPn + Vo, n Vl,n+lPn+l + «0,n«0,nPn + VO,nV-l, n -lPn-l 
+ V-l,n-lVl,nPn + U-l.n-l^O.ri-lPn-l + «-l,n-l«-l,n-2j3n-2 = «l,n+l«l.n+lPn+2 + 

,n u — l,7i— 1 ~r 

V— l,n.— 1^0, n — l).Pn — 1 H~ ^— l,n— 1^— l,n— 2Pn— 2 " ^l,n+l^l,n-f lPn+2 H~ ^l,n+l ,n-t-l ~r 

w -i,ri-i u -i,n-2Pn~2- We dropped arguments to simplify calculations. Remember- 
ing that: p 2 = 2±pj - (/3l a/ o) Pi ~ S we have: 

P2Pn = ^(vi,n+lVl,n+lPn+2 + «l : n+l («0,n+l + «0,n) + (t<l,n+l V-l,n + V ,nVQ,n + 
^— l,n— 1^1, n 

)p n +V-i 

,n—l \'^0,n~\~'^0,n— 1 )Pn-l+W-l,„-lW-l, n -2Pn-2)-^T 2 ^ 1 ( w l,«+lP«+l + 
UO,nPn+«-l,n-lPn-l)-^Pn = Pn+2fj«l,n+lWl,«+l+Pn+l(|j«l,«+l(wo,n+l+Wo,r 1 )- 
^l.ri+l^TT 1 ) +Pn(^(«l,n+lU-l,„ + Uo,n«0,n + U-i,„-iWi, n ) - ^T^Vo.n ~ ^) + 

Pn-i(^w-i : n-i(vo,n + v , n -i) - Pl ~f° + ^■«_i,„-iW-i,„_2Pn-2- Compar- 

ing coefficients by p n +2, Pn+i, Pn, Pn-i, and p„_2 we get our assertion. Now let 
us assume that we deal with harness that is following assertion of Theorem [4] we 
assume that: 

gig) 1 Toft) = S§ = P(t) PM-PoW = ZWZ = b + M*) 

a 2 ft) a + apft)' a 2 (i) ^44 a + apft) ' «2(» ^44 a + apft) ' 

ai(t) ai(t) 

u_i,„_i (t) = c„_i + c„_ip(i), v ,«(i) = &n + b n p(t), wi, n+ i(t) = a„+i + a„ + ip(t), 
with Co = c, Co = c, 6i = &, 6i = 6, ai — a, a\ = a. □ 

Proof. Now to prove Theorem|3]we combine equations from the assertion of Lemma 
31 simplifications from Lemma [5] and formulae for coefficients A, B, C, D, E, F 
given by Lemma U We collect all expressions on one side of these equations and 
factor out (with the help of Mathematica). It turns out that this factorization is 
of a form : Certain expression involving sequences a n , a n , b n , b n , c n and c„ times 
some expressions depending on t. Hence to satisfy our equations expressions in this 
factorization that do not depend on t must be set to zero. □ 
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